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Abstract. We investigate the asymptotic behavior of the least squares estima- 
tor of the unknown parameters of random coefficient bifurcating autoregressive 
processes. Under suitable assumptions on inherited and environmental effects, we 
establish the almost sure convergence of our estimates. In addition, we also prove 
a quadratic strong law and central limit theorems. Our approach mainly relies 
on asymptotic results for vector-valued martingales together with the well-known 
Rademacher-Menchov theorem. 



The purpose of this paper is to study random coefficient bifurcating autoregressive 
processes (RCBAR). One can see those processes in two different ways. The ffist one 
is to see them as random coefficient autoregressive processes (RCAR) adapted to 
binary tree structured data, the second one is to consider those processes as the as- 
sociation of RCAR processes and bifurcating autoregressive processes (BAR). BAR 
processes have been ffist studied by Cowan and Staudte [6] when RCAR processes 
have been ffist investigated by Nicholls and Quinn [20| [2T] . The RCBAR structure 
allows us to reckon with environmental effects and inherited effects in order to better 
take into account the evolution of the characteristic under study. One shall see cell 
division as an example of binary tree structured data. 

Let us detail what a RCBAR process is. The ffist individual is designated as the 
individual 1 and each individual n leads to individuals 2n and 2n + l. X„ will stand 
for the characteristic under study of individual n. We can now make explicit the 
ffist-order RCBAR process which is given, for all n > 1, by 



The driven noise sequence (£2n;^2n+i) represents the environmental effect while the 
random coefficient sequence (a^, &n) represents the inherited effect. Keeping in mind 
the example of cell division, we assume that e2n and e2n+i are correlated in order to 
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take into account the environmental effect on two sister cells. 

Our goal is to study the asymptotic behavior of the least squares estimators of 
the unknown parameters of first-order RCBAR processes. In contrast with the pre- 
vious work of Blandin where the asymptotic behavior of weighted least squares 
estimators were investigated, we propose here to make use of a totally different 
strategy based on the standard least squares (LS) estimators together with the well- 
known Rademacher-Menchov theorem. The martingale approach for BAR processes 
has been first suggested by Bercu et al. |3], followed by the recent contribution of 
de Saporta et al. 13 IE]- We also refer the reader to Blandin [5J for the study 
of bifurcating integer-valued autoregressive processes. Our approach relies on the 
Rademacher-Menchov theorem which allows us to study the LS estimates in a differ- 
ent way as in de Saporta et al. [8]. In particular, we drastically reduce the moment 
assumptions on the random coefficient sequence (a„, bn) and on the driven noise 
sequence {e2n, ^2n+i)- We shall also make use of the strong law of large numbers for 
martingales [10] and also the central limit theorem for martingales [TOt [T2] in order 
to study the asymptotic behavior of our LS estimates. The martingale approach of 
this paper has also been used by Basawa and Zhou |21 EDI EI]- 

Since several methods have been proposed for the study of BAR processes, we 
tried to take into consideration each of them. In this way, we took into account the 
classical BAR approach as used by Huggins and Basawa [Til [15] and by Huggins and 
Staudte [16j who investigated the evolution of cell diameters and lifetimes. We were 
also inspired by the bifurcating Markov chain approach brought in by Guyon [llj 
and applied by Delmas and Marsalle [9j . We also reckoned with the analogy with the 
Galton- Watson processes as in Delmas and Marsalle |9] and Heyde and Seneta |13] . 
Even though we chose to use LS estimates, different methods have been investigated 
for parameter estimation in RCAR processes. While Koul and Schick used an 
M-estimator, Aue et al. [Ij tackled a quasi-maximum likelihood approach. Vanecek 
|28] used an estimator first introduced by Schick [23j. On their side, Hwag et al. 
[17] studied the critical case where the environmental effect follows a Rademacher 
distribution. 

The paper is organised as follows. We will explain more accurately the model we 
will consider in Section 2, leading to Section 3 where we will give explicitly our LS 
estimates of the unknown parameters under study. The martingale point of view 
chosen in this paper will be highlighted in Section 4. All our results about the 
asymptotic behavior of our LS estimates will be stated in Section 5, in particular 
the almost sure convergence, the quadratic strong law and the asymptotic normality. 
Section 6 is devoted to the Rademacher-Menchov theorem. All technical proofs are 
postponed to the last sections. 
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2. Random coefficient bifurcating autoregressive processes 
We will study the first-order RCBAR process given, for all n > 1, by 



(2.1) 



^2n — O'n^n + £2n) 
X2n+1 — bnXn + £2n+l) 



where Xi is the ancestor of the process and (£2ni^2n+i) is the driven noise of the 
process. We will suppose that E[X^^] < oo and we will also assume that the two 
sequences (a„, 6„) and (£2n,£2n+i) are independent and indentically distributed and 
are also mutually independent. An RCBAR can be seen as a first-order autore- 
gressive process on a binary tree, each node of this tree representing an individual 
and the first node being the ancestor. For all n > 1, G„ will stand for the n-th 
generation, that is to say 



G„ = {2",2" + 1,...,2 



n+l 



1}- 



We will also denote by T„ the set of all individuals up to the n-th generation, namely 

n 
n=0 

One can immediately see that the cardinality of Gn is 2"", while that of T„ is 
2"+i — 1. We will note Gr„ the generation of individual n, r„ = log2(n). Let us recall 
that the two offspring of individual n are individuals 2n and 2n + 1 and conversely, 
the direct ancestor of individual n is individual [n/2] where [x] stands for the integer 
part of X. 




G„ 
















I 1 




V 1 





FlGURE 1. The tree associated with the RCBAR 
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3. Least squares estimators 

Let (J-'n) be the natural filtration associated with the generations of our first-order 
RCBAR [Xn), namely J^n = (^{Xk, k G T^} for all G N. In all the sequel, we will 
assume that for all n > and for all k G G„, 



(3.1) 



IE[afc|^n] = a, E[bk\J^n] = b, 

'E[e2k\J^n] = c, E[e2k+l\J^n] = d 



a.s. 



Consequently, (2.1) can be rewritten as 
(3.2) 




aXn + C+ V2n, 
hXn + d + V2n+1, 

where, for all k G G„, V2k = X2k - E[X2k\J^n] and V2k+i = X2k+i - E[X2k\J^n]- We 
can rewrite the system (3.2) in a classic autoregressive form 

+ Wn 



(3.3) 
where 



Xr, 



Xr. 



X2n 
X2n+l^ 

and the matrix parameter 9 given by 



e 



^ r 



Xr. 
1 



V2n 
V2n+1 



a b 
c d 



One of our goal is to estimate 6 from the observation of the n first generation, namely 
T„. We will use the least squares estimator 6n of 6 which minimizes 



Hence, we obviously have 



where S'„ is the matrix given by 



keTn 



feGT„ 



In order to avoid any invertibility problem, we will assume that 5*1 is invertible. 
Otherwise, we only have to add the identity matrix of order 2, I2, to Sn- Moreover, 
we will make a slight abuse of notation by identifying 6 and 6n to 



vec(^) 



c 
b 

\dj 



and 



vec 



bjn 
\dnj 
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fcGT„ 



XkX2k+l 
\ X2k+1 ) 



where Y^n = ^2® Sn and (8) stands for the standard Kronecker product. Hence, (3.3) 
yields to 

f XkV2k \ 

(3.4) e^-e = 



fc6T„ 



V2k 
XkV2k+l 
\ V2k+1 J 

In all this paper, we will make use of the following hypotheses on the moments of the 
random coefficient sequence (an,&n) and on the driven noise sequence {e2ni^2n+i)- 
One can observe that for all n > and for all k G G^, the random coefficients a^, 
hk and the driven noise e2ni ^2n+i are J-'„+i-measurable. 

(H.l) For all n > 1, 



E[a^^] < 1 and Effe^*^] < 1 



16i 



supE[4^] 

n>l 



< OO 



and 



supE[e2^^i] < OO. 

n>l 



(H.2) For all n > and for all keGn 

Var[afc|J-'„] = cr^ > and Var[6fc|J-!„] = o"^ > a.s. 

Var[£:2fe|^n] = cr^ > and Var[£:2fc+i|^n] = o"^ > a.s. 
(H.3) It exists p^^ < cr^o"^ and p^^ < cr^crj such that for all n > and for all k G G„ 

¥.[{ak - a){hk - h)\J^n] = Pab a.s. 

E[(e2fc - c)(£:2A:+i - d)\J^n] = Pcd a.s. 

Moreover, for all n > and for all k,l G G„, with k ^ I, {e2k,£2k+i) and 
{£2i,£2i+i) as well as {ak,bk) and {ai,bi) are conditionally independent given 

(H.4) One can find p^ > cr^, p^ > cr^, p^ > and p^ > such that, for all n > 
and for all k G G„ 

E [{ak - a)"^ \ J^n] = /ia aiid E [{bk - b)^ \ J^n] = fJ't a.s. 
E [{e2k - c)'^ \J^n] = Ate and E [(£:2fc+i - d)^ | j:„] = fxj a.s. 



netk] > n4kV and E[etk+i] > E[£ 



2k+l\ 



In addition, it exists z/^^ > p^^ and > p^^ such that, for all k G 



E[{ak-af{bk-bf\J^n 



and E[(£:2fe - c)^(£2fc+i - dY\J^n 



a.s. 
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(H.5) It exists some a > 4 such that 

sup sup ]E[|afc — a|°|J>^] < oo, sup sup K[\bk — 6|°|-7-'„] < oo a.s. 

n>0 fceG„ n>0 fceG„ 

sup sup ]E[|£:2fc — c|"|J-'„] < oo, sup sup E[|£:2fe+i — c?|"|^n] < oo a.s. 

n>0 fceG„ n>0 fcGG„ 



One can observe that hypothesis (H|2]) allows us to consider a classical BAR process 
where = a and bk = b a.s. Moreover, under assumptions (H|2]) and (Hjsj), we 
have for all n > and for all k G G„ 

(3.5) ElV.llJ'n] = crlXl + al Ei^^Uil-^n] = cylxl + al a.s. 

(3.6) '^\V2kV2k+l\J^n] = PahXl + pcd a.S. 



We deduce from (3.5) that, for all n > 1, we can rewrite as 

= ^Vn + V2n, 

where 

V = (^tj and ^pn = 
It leads us to estimate the vector of variances rj by the least squares estimator 
(3.7) Vn = Q-\ Yl ^^IV'fc, 



where 



and for all k G G„, 



fceT„ 



V2k — X2k — O-nXk — C„, 

V2fc+1 = X2k+l — bnXk — dn 



We clearly have a similar expression for the estimator of the vector of variances 
= [al 0"^) by replacing V2k by V2k+i into (3.7). By the same token, it follows 



from (3.6) that, for all n > 1, we can rewrite V2„V2„+i as 

V'2n'^2n+l = I^Vn + W2n 

where u is the vector of covariances v = (^Pab Pcdf ■ Therefore, we can estimate u 

by 

(3.8) = Q:^\ ^ V2kV2k+ii^k- 
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4. A MARTINGALE APPROACH 



We already saw that relation (3.4) can be rewritten as 
(4.1) 6^-6 = S;\M„, 

where 

\ V2k+l j 

The key point of this study is to remark that (M„) is a locally square integrable 
martingale, which allows us to make use of asymptotic results for martingales. This 
justifies our vectorial notation introduced previously since most of those asymptotic 
results have been established for vector-valued martingales. In order to study this 
martingale, let us rewrite M„ in a more convenient way. Let '^n = ^2® V^n where 
is the 2x2" matrix given by 



1 



X2»i + l 
1 



^2"+l — 1 
1 



The first line of gathers the individuals of the n-th generation, can also be 
seen as the collection of all G G„. Let ^„ be the random vector of dimension 

2" gathering the noise variables of G„, namely 



2"+2 



2"+i_2 ''2"+l 



Von 11 Von 



2"+3 



2n + l-l 



)• 



The special ordering separating odd and even indices has been made in Bercu et al. 
[3] in order to rewrite M„ as 



k=l 



It clearly follows from (HjT|) to (Hj3|) that (M„) is a locally square integrable 
martingale with increasing process given, for all n > 1, by 



n—l n— 1 



with 



fc=0 fc=0 



(4.2) (M)„ = 5^vl/,E[a+ieUil-^fc]^i = Y.^^ ^-^^ 
where 

(4.3) = E ( ^ 



(P{X,) Q{X,)\ (XI X, 
0{Xu) RiXk)J^\Xk 1 



r P{X) = alX' + al 
(4.4) lQ{X) = pa,X^ + p,a 

[r{X) = alX^ + al 
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The first step of our approacli will be to establish the convergence of (M)„ properly 
normalized, from which we will be able to deduce several asymptotic results for our 
RCBAR estimates. 

5. Main results 
Lemma 5.1. Assume that (Hjl]) is statisfied. Then we have 



(5-1) lif nn 5Z 



Sp a.s. 



where Sp is a constant depending only on the moments ofai, bi, £2 and up to the 
p-th order. 

Remark 5.2. In particular, we have 

c + d 

Sl 



2-{a + b)' 



_ {ac + bd){c + d) + aj + + d"^ 



2 - (f^^ + + a^ + b^)\ 2-{a + b) 2 
and explicit expressions for S3 to sg are given at the end of Section \2\ 

Proposition 5.3. Assume that (Hjl]) to (Hjsj) are satisfied. Then, we have 
(5.2) lim = L a.s. 

n^oo |T„_i I 

where L is the positive definite matrix given by 

Pcd 



pcd (j'd \Pab <yt 



where 



(5.3) C=['^ and D = 

\Si 1 I \S3 S2 



Remark 5.4. One can observe that we only need to assume for convergence (5.2) 
that 

E[<]<1, Elbl]<l, supE[4j<oo, supE[£^„+J<oo. 

n>l n>l 

Our first result deals with the almost sure convergence of the LS estimator 6'„. 

Theorem 5.5. Assume that (h|i]) to (U^ are satisfied. Then, On converges 
almost surely to 9 with the almost sure rate of convergence 

In addition, we also have the quadratic strong law 
1 " 

(5.4) lim - y \Tk-i\{ek - eyAiOk -6)= tr{K-^'^LK-^l^) a.s. 

k=l 
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where 

A = l2®{C + D). 

Our second result concerns the almost sure asymptotic properties of our least squares 
variance and covariance estimators r]ni Cn and z/„. We need to introduce some new 
variables 



Vn = Qn-l Yl ^afc^-fc, 

feeT„_i 
fceT„_i 



fceT„_ 



1 



Theorem 5.6. Assume that (h|i]) to (Hjsl are satisfied. Then, fjn and (n both 

converge almost surely to rj and ( respectively. More precisely, 

(5-5) \\Vn-Vn\\ = O (^ ^^ ^ J a.s. 

(5.6) ||C„-C„|| = o(^^^^ a.s. 
In addition, Vn converges almost surely to v with 

(5.7) \\Un - l^nW = ^ (^ I'J^ 1 ^ 

Remark 5.7. We also have the almost sure rates of convergence 

- 

Finally, our last result is devoted to the asymptotic normality of our least squares 
estimates 9n, ffn, Cn and z/„. 

Theorem 5.8. Assume that (Hjl]) to (H|5]) are satisfied. Then, we have the 
asymptotic normality 

(5.8) V\^n-i\{9n -e)-^ Ar(0, V-^LV-^). 
In addition, we also have 

C 



(5.9) V|T„-i| ijin -V)^ Ar(0, A-'MacA-') 

(5.10) V|T„_i| (Cn - C) ^ Ar(0, A-'MmA-'] 



where 



r = J, ® c, A 



S4 S2 
S2 1 



S4 


S2 










S2 
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Finally, 

(5.11) V|T„_i| (z7„ - I.) ^ AT (0, A-^ifA-i) 

The rest of the paper is dedicated to the proof of our main results. 

6. On the Rademacher-Menchov theorem 

Our almost sure convergence results rely on the Rademacher-Menchov theorem for 
orthonormal sequences of random variables given by Rademacher [22| and Menchoff 
] , see Stout Pl] and also Tandori [2^1 EZI and an unpublished note of Talagrand 
for some extensions of this result. 



Theorem 6.1. Let (Xn) be an orthonormal sequence of square integrable random 
variables which means that for all n ^ k, 

E[XnXk] = and E[X^] = 1. 

Assume that a sequence of real numbers (a„) satisfies 

oo 

(6.1) 5];a2(logn)2<oo. 

Then, the series 



n=l 



(6.2) 



k=l 



converges almost surely. 



Remark 6.2. One can observe that (X„) is neither a sequence of independent ran- 
dom variables nor a sequence of uncorrected random variables since (X„) is not 
necessarily centered. In addition, in the case where (X„) is an orthogonal sequence 



of random variables, we have the same result (6.2), replacing (6.1) by 

oo 

J2alml]{\ognf <oo. 

n=l 

Moreover, if a„ = 1/n, it follows from ( |6.2[ ) and Kronecker's lemma that 

1 " 

lim — > Xfc = a.s. 

T7.— vno n t ^ 



n^oo n 

k=l 
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7. Proof of the keystone Lemma 15.11 

We shall introduce some suitable notations. Let be the sequence defined, for 
all n > 1, by = and P2n+i = bn- Then (2.1) can be rewritten as 

Consequently, for all n > 2 

Xn = l^nX^n-^ + En- 
First of all, let us prove that 

lim j;^Ln = si where L„ = y^Xk. 



One can observe that 



Ln — ^ Xk — Xi + ^ ^/3fcX|-|j + Ek 

feeT„ fceT„\To ^ 

= -^1+ {(^kXk + E2k + bkXk + E2k+l), 

= Xi + {a + h)Ln-i + + Bn-i + 

where 

An=y^ Xk{ak - a), Bn = ^ Xk{bk - b), £"„ = ^ {E2k + £2k+i)- 
feeT„ fceT„ fceT„ 

Hence, we obtain 

Ln _ Xi (2 + b Ln-l An-l -Bn-1 -E'n-1 



2^+1 2"^""*" 2 2" 2"^"'" 2"^"*" 2"^"*" 



n _ /' a + b \" Lq / g + & V / Xi 

^ ~\^2y2^V2y V2'=+i 2'^+! 2^=+! 2^+1 

Recalling that |T„| = 2"^^^ — 1, the standard strong law of large numbers immediately 
implies that 

E 

lim = E[e2 + E3] = c + d a.s. 

n^oo Z 

Let us tackle the limit of An using the Rademacher-Menchov theorem given in 
Theorem |6.1[ Let Yn and i?„ be defined as 

n 

Yn = X„(a„ - a) and Rn = ^ Y^. 

k=l 

For all n > and for all k G G„, 



E[afc — a\J-'n] = E[ak — a] = 0. 



12 
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Moreover, we clearly have for all n > 2 and for all different k, I € G„, 
E[YkYi] = E [E[XkXi{ak - a)iai - a)| j;]] , 

= E [XkXiE[ak - a\J^nMai - a|J^„]] , 
= 0. 

It means that is a sequence of orthogonal random variables. In addition we 
have, for all n > and for all k G G„, 

E[Y,^]=E[E[Xi{ak-af\J'n]], 

= E [XlE[{a, - a) = a^E[X|]. 

In order to calculate E[X^^], let us remark that 



'r„-l 



,-1 /fc-1 



n%i ■'f.+E n%i 



. fe=0 



k=0 \i=0 



Consequently, 
EM = E 



. k=0 



+ E 



^r„-l /k-l 



, fe=0 \i=0 



2»J / ^[2*^] 



r„-l 



+ 2 



k=0 



1=0 



First of all. 

Next, for the cross term 



E[Xl] E 



fc=0 



< E[X^] max(E[af],E[6f])'-" < E[Xi]. 



fe=0 



z=o 



A;=0 



2k 1 



•n-l 

He 



\l=k+l 

= E (iiE k]]) ( n E hj]]) E 

A;=0 \i=0 L -I/ V=fc+1 / 

rn-1 

< E[|Xi|] ^ max(E[a?],E[62])'=max(|a|, I^D^--^^"^ max(|ac|, 

fe=0 

max(|a|, \h\Y- - max(E[a?], E[62])'-" 



< E[Xi]max(|ac|, 

< E[Xi]max(|ac|, \hd\)- 



max(|a|, -max(E[a?],E[62]) ' 
1 

max(|a|, - max(E[af], E[62])| ' 
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Finally, for the last term, 



E 



^rn — l /k—l 



^ n%] 



, k=Q \i=0 



k=l 1=0 

r„-l fc-1 



7-1 



fc-1 



n%] n ^f,]^mm^] 



.i=0 j=l+l 



k=0 



■fc-1 

.2=0 



2 



< 2 ^ ^max(E[a^],E[62])'max(|a|, max(|ac|, max(|c|, \d\f 

k=l 1=0 

r-n-l 



< 2 



max (ac 


, fed ) max( c 


■ Ml) 


r 1 


max(|a 


,|6|)-max(E[a?],E[fe?])| 


i^l — max(|a 


,\b\) 



+ ^ max(E[a^],E[62])'=max(E[£^],E[£2]), 

1 



fe=0 



+ 



+ 



max(E[£i],E[£2]) 



1 -max(E[af],E[6f])' 

To sum up, we proved that it exists some positive constant /i such that, for all n > 0, 
E[X^] < leading to 

11 II 

n=l n=l 

Therefore, it follows from the Rademacher-Menchov theorem that the series 



n 



k=l 



converges a.s. Consequently, Kronecker's lemma imphes that 

1 " 1 
lim — N Yn— lim —Rn — 

In particular 



a.s. 



fe=i 



n— >-oo 7T, 



1 



lim T^^Rnj — lim j^j^A^ = a.s. 

n->oo 



Hence, we find that 



lim — — 
By the same token, we also have 



IT 



An — Q a.s. 



lim - ,^j^n 



Br, = a.s. 



To sum up, we obtain that 
(7.2) 



An-l Bn-l En-l _ C + d 
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Therefore, we deduce from (7.1) and (7.2) together with the assumption that \a\ < 1 
and |6| < 1, that 

(7.3) hm — ^ = r a-S- 

^ ^ n^oo 2"+i 2 ^ a + b 

2~ 

leading to 

hm r > Xk = — ^ r a.s. 



c + d 

n^oo |X„| 2 — (a + b) 



Let us now tackle the study of 
First, one can observe that 

= ^1 + ( E ^l^h]] + 2 ( E ) + ( E 

\fceT„\To / \feeT„\To / \fceT„\To 

= + {al + al + + b'^)K^_i + 2(ac + 6ci)L^_i + + + E^-i, 

where 

A„ = J] X,2(a2 + bl - {al + al + a? + b')), 

fc6T„ 



5„ = ^ Xk{ake2k + bke2k+i - {ac + bd)), 

n 

En= Y {elk + ^2 



A:eT„ 



''2k+lj 



Hence we obtain, as for L„ 



on+l 2 ^ I 2^+1 

fc=l ^ 



-^n , . n_fc -^1 , Lk-l Ak-l -Bfe-1 -Efc-l 

2k 2^+1 2*^+^ 2^^+! 



where, since E[a^,] = + < 1 and E[6^] = + 6^ < 1, 

/i = -^^^ < 1 and p = ac + bd. 

As previously, the strong law of large numbers leads to 
(7.4) lim T^.En = al + al + c^ + d^ a.s. 

n— >oo li „ 

Moreover, it follows once again from the Rademacher-Menchov theorem with Kro- 



necker's lemma, (7.3) and (7.4) that 



Kn 1 / c + d al + aj + c^ + d^ , 

hm — — = u — + — a.s. 

n^oo 2"+i l-fi\2-{a + b) 2 
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leading to convergence (5.1) for p = 2. We shall not carry out the proof of (5.1) for 
3 < p < 8 inasmuch as it follows essentially the same lines that those for p = 2. One 
can observe that, in order to prove (5.1) for 3 < p < 8, it is necessary to assume 
that E[al^] < 1, E[bl^] < 1, E[el^] < oo and E[ef] < oo. The limiting values S3 to 
Sg may be explicitly calculated. More precisely, for all p G {1, 2, . . . , 8}, denote 

Ap = E[a% B, = E[b% C, = E[el], Dp = E[4]. 

We already saw that 



Sl 



S2 



2-{A2 + B2 



2-(Ai + Si)' 
iA^C^ + B,D,)s,+ 



The other limiting values S3 to Sg of convergence (5.1) can be recursively calculated 
via the linear relation 

'p-i 



2 - (Ap + 5p 



8. Proof of Proposition [5^ 



The almost sure convergence (5.2) is immediate through (4.2), (4.3) and Lemma 



5.1, Let us now prove that L is a positive definite matrix. First, the matrices 

2 

and 



Pab 

2 



a 



a 



Pcd 

Pcd c^j 



are clearly positive semidefinite and positive definite under (HjSj). Moreover, D is 
clearly positive semidefinite since 



lim 



IT I 



E 



D 



a.s. 



Finally, let us prove that C is positive definite. Its trace is clearly greater than 1, 
hence we only have to prove that its determinant is positive. Its determinant is 
given by 



S2 



2 - {(yl + crl + a2 + 62) 



[ac + hd){c + d) 
2 - (a + 6) 



+^71 + 0^ + ^" 



c + d 



{a + h) 



+ 



c + d 



{a + h) 



crt 



62) 



+ 



{ad — be + c — dy 



2-{cTl + al + a^ + b^) (2-(a + 6))2 ' 

The first term of this sum is positive since under (H|i]) o"^ + o"^ + + 6^ < 2 
and since under (H|2]) ct^ + cr^ > 0. Moreover, the two other terms are clearly 
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nonnegative, which proves that this matrix is positive definite. Since the Kronecker 
product of two positive semidefinite (respectively positive definite) matrices is a 
positive semidefinite (respectively positive definite) matrix, we can conclude that L 
is positive definite. 

9. Proofs of the almost sure convergence results 

We shall make use of a martingale approach, as the one developed bu Bercu et 
al. [3] or de Saporta et al. [8J. For all n > 1, let 

Vn = Mip-\M^ = {9^ - 0)S„_iP-_\S„_i(ft„ - d) 

where 



Xk 1 

By the same calculations as in [3j, we can easily see that 

(9.1) Vn+l + An = Vl + Bn+i + Wn+1 , 

where 

n 

An = Y,MUp-_\-P^')Mk, 

k=l 

n n 

Bn+1 = 2 J2 Mip-'AMk+i and = J] AMi^,P,'AMk+i. 

k=l k=l 

Lemma 9.1. Assume that (Hjl]) to (Hjsj) are satisfied. Then, we have 

(9.2) hm — = Itriih ® (C + D))-^'^L{h ® (C + D))-^'^) a.s. 



where C and D are the matrices given by (5.3). In addition, we also have 

(9.3) Bn+i = o(n) a.s. 
and 

(9.4) ^"+^ + ^" = Itriih ®iC + D))-^'^L{h ® {C + D))-^'^) a.s. 

Proof. First of all, we have Wn+i = + T^n+i where 

_ " AM*+i(/2 ® (C + D))-^AMk+i 

In+l - 



k=l 







{C + D))-^)AMk+i 









k=l 

One can observe that Tn+i = tr^^h ® (C + D))-^l^'Hn+i{h ® {C + D))-^''^) where 



ifc=i 
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Our aim is to make use of the strong law of large numbers for martingale trans- 
forms, so we start by adding and subtracting a term involving the conditional ex- 
pectation of AHn+i given T^- We have thanks to relation (4.2) that for all n > 0, 
E[AM„+iAM*+i|j:„] = Ln. Consequently, we can split "Hn+i into two terms 



+1 



k=\ 



where 



fc=i 



IT, 



It clearly follows from convergence ( |5.2[ ) that 

lim -— ^ = -L 



a.s. 



Hence, Cesaro convergence theorem immediately implies that 

1 , 



(9.5) 



hm — > — — 



a.s. 



On the other hand, the sequence (/Cn)n>2 is obviously a square integrable martingale. 
Moreover, we have 



1 



|T„ 



■(AM„+iAM*^i -L„). 



For all M G M^, denote [u) = u^JCnU. It follows from tedious but straightforward 
calculations, together with Lemma 5.1 , that the increasing process of the martingale 
{}Cn{u))n>2 satisfies (/C(n))„ = 0{n) a.s. Therefore, we deduce from the strong law 
of large numbers for martingales that for all u G M^, K,n{u) = o{n) a.s. leading to 
)Cn = o{n) a.s. Hence, we infer from (9.5) that 



(9.6) 



lim 



L 



a.s. 



Via the same arguments as in the proof of convergence (5.2), we find that 



(9.7) 



lim 



IT. 



h^iC + D) a.s. 



Then, we obtain from (9.6) that 



lim 



tr{{h ® (C + D))-^I^L{h ® (C + D))-^/^) 



a.s. 



which allows us to say that IZn = o{n) a.s. leading to (9.2). We are now in position 
to prove (9.3). Let us recall that 



= 2 Mlp-'^Mu+i = 2 KPk'^^ki 



k+l- 



k=l 



k=l 
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Hence, is a square integrable martingale. In addition, we have 

Consequently, 

E[(AS„+i) Vn] = 4E[M*p-iAM„+iAM*+iP-iM„|J-„] a.s. 

= 4M*p-iE[AM„+iAM*+i|J-„]p-iM„ a.s. 
= AMip-^LnP-^Mn a.s. 



However, we already saw from ( |4.3[ ) that 

(P[Xt) Q[Xt)\^(Xl Xt 



Moreover, 



AP„ = P„-P„_i= + 



fceGn 

For a = max(crf , a^) + max((T^, crj) + max(|pab|, |pcd|), denote 
_ ,a(l + X2)-P(X„) -g(x„) 

" ' -g(x„) «(i + x2)-p(x„ 



where P(X„), Q(X„) and P(X„) are given by (4.4). It is not hard to see that 



We claim that A„ is a positive definite matrix. As a matter of fact, we deduce from 
the elementary inequalities 

'O < P(X) < max(a2,a2)(l + X2), 
(9.8) <( 0<P(X) <max(a2,(T2)(l + X2), 

|g(X)| <max(|p,,|,|p,,|)(l + X2), 



that 



tr(A„) = 2a(l + Xl) - P(X„) - P(X„) 

> (2a - max(a^, al) - max{al aj))(l + X^) > 0. 



In addition, we also have from (9.8) that 
det(A„) = (a(l + Xl) - P(X„))(a(l + X^) - P(X„)) - Q'(X„), 

= a{l + Xl) (a(l + Xl) - P(X„) - P(X„)) + P(X„)P(X„) - g'(X„), 

> P(X„)P(X„) + «(1 + X^)2 max(|p,,|, \p,d\) - Q^X^), 

> P(X„)P(X„) + max(|p,,|, \pcd\)\l + Xlf - Q\Xn) > 0. 

Consequently, A„ is a positive definite matrix which immediately implies that L„ < 
q;AP„. Moreover, we can use Lemma B.l of [3j to say that 

p-i AP P^^ < P^^ — P~^ 



A RADEMACHER-MENCHOV APPROACH FOR RCBAR PROCESSES 19 

Hence 

E[(AS„,+i)2| J-n] = AMlp-^LnP-^Mn a.s. 

< AaMip-^APnP~^Mn a.s. 

< 4aM*(P„-_\ - P-1)M„ a.s. 



leading to (i3)„ < AaAn. Therefore it follows from the strong law of large numbers 
for martingales that i3„ = o{An)- Hence, we deduce from decomposition (9.1) that 

Vn+l + An = 0{An) + 0{n) a.S. 

leading to V„+i = 0{n) and An = 0{n) a.s. which implies that S„ = o{n) a.s. Fi- 
nally we clearly obtain convergence (9.4) from the main decomposition (9.1 ) together 
with (9.2) and (9.3), which completes the proof of Lemma 9.1 □ 



Lemma 9.2. Assume that (H|T]) to (Hjsj) are satisfied. For all 5 > 1/2, we have 



\Mnf = o{\Tn\n^) a.s. 



Proof. Let us recall that 



E 



fceT„ 



/ XkV2k \ 
\ V2k+1 J 



Denote 



T 



and 



feeT„ 



On the one hand, T„ can be rewritten as 



Tn = Y A/|Gfc_i|/fe where /„ 
k=i 



We already saw in Section 3 that, for all n > and for all k G G„, 

nV2k\J'n] = and E[Vi,\J^n] = a^Xi + al = P{Xk) a.s. 
In addition, for all k G G„, 



which implies that 
(9.9) 



ny2k\^n] = fitXl + QaXXi + fit a.s. 



E[\/2ll-^n]</iL(l + ^fcT a.s. 
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where /i^^ = max(/i^, Sa^cr^, /i^). Consequently, E[/„+i|J>i] = a.s. and we deduce 
from (9.9) together with the Cauchy-Schwarz inequahty that 

4 



1 



■E 



J2 ^-^^^fc] 



T 
•J n 



+ 



|G„| 



J2 J2 ^'^"^i^2l\J'nnV,]\J^n 



k£G„ leGn 
l^k 



leading to 



E[/til-^n] < ^ E Xt{l + Xir + 3 medial, alf (j^ Yl ^"(^ + 



Therefore, we infer from Lemma |5.1| that 

p4 



supE[/„_^.JJ'„] < oo a.s. 



n>0 



Hence, we obtain from Wei's lemma given in [29j page 1672 that for all 5 > 1/2, 



= o{\Tn-i\n^) a.s. 



On the other hand, f/„ can be rewritten as 



"k-l 



\gk where gr, 



1 



fceG„ 



k=l V l-J^n-l| 

Via the same calculation as before, E[(7„+i|J>i] = a.s. and 

Hence, we deduce once again from Lemma 5.1 and Wei's Lemma that for all 5 > 1/2, 

= o{\Tn-i\n^) a.s. 

In the same way, we obtain the same result for the two last components of M„, 

□ 



which completes the proof of Lemma 9.2 



9.1. Proof of Theorem 

which implies that 



5.5 



\9r.-9r < 



We recall that V„ 



)Sn-l-P„-l^n-l(^n 



^min{^n~lPn—l^n—l J 



On the one hand, it follows from (9.4) that Vn = 0(n) a.s. On the other hand, we 
deduce from Lemma [5.11 that 

(9.10) hm ^ 



lo ®C a.s. 
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where C is the positive definite matrix given by (5.3). Therefore, we obtain from 
( |9^ and (|9l| that 

^min{^n—lPn—l^n~l] 



hm 

n— ^oo 



|T„_i| 

Consequently, we find that 



Xrmn{C{C + D)-^C) > a.S. 



9n-9f = 



n 



\Tn-l\ 



a.S. 



We are now in position to prove the quadratic strong law (5.4). First of, all a direct 
application of Lemma 9.2 ensures that V„ = o{n^) a.s. for all 5 > 1/2. Hence, we 
obtain from (9.4) that 



lim = \tr{{h ®{C + D))-^'^L{h ® {C + D))-^/^) 

n-s>oo n 1 



(9.11) 
Let us rewrite An as 

n n 

An = Y.Mi {p-_\ - P-') M, = Y, MiP^^l'A.p-^i'M,, 

k=l k=l 

1/2 "1 1/2 A V 

where A^ = h — Pk-iPk ^k-i- already saw from (9.7) that 



a.S. 



lim 



IT. 



/2 ® (C + D) a.S. 



which ensures that 



lim Ar, 



'■n — ;r-'4 a.S. 



In addition, we deduce from (9.4) that An = 0{n) a.s. which implies that 
(9.12) 



Moreover, we also have 

- J2 KPk-iM, = - J2i0k - eyp.-.ie, - 6), 



a.S. 



k=l 



n 



k=l 



1 " 

-J2\^k-,\{ek- 



k=l 



Pk-1 

|Tfe_i| 



(9.13) 



1 " ^ 

- V |T,_i|(e, - e)\h ®{C + D)){dk -e) + o(l) a.S. 
n ^-^ 



k=l 



Therefore, (9.11) together with (9.12) and (9.13) lead to (5.4). 
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9.2. Proof of Theorem 5.6 We only prove (5.5) inasmuch as the proof of (5.6) 
foUows exactly the same lines. Relation (3.7) immediately leads to 

n-l 

1=0 keGi 
n-l 

(9.14) =Y.Y1 - V2kY + 2{V2k - V2k)V2k) ^k. 

Moreover, we clearly have from Section [3] that, for all n > and for all k G G„ 



V2k — V2k 



an — a 

C77, c 



which implies that 



{y2k - V2kf < {{an - ay + {cn - c)') ||$fcf = ((a„ - a)2 + (c„ - cf) (1 + X, 



In addition, since Wi^kW = 1 + < (1 + X^)^, we have 



n-l 

i=0 feeG; 



n-l 
i=0 



+ (q-c)^)E(1 + ^' 



2\2 

k) ■ 



However, it follows from Lemma 5.1 that 



J2(^ + Xiy = 0{\G,\) a.s. 



and since A is positive definite, (5.4) leads to 

n— 1 



J2 ((«/ - + (Q - cf) = 0{n) a.s. 



1=0 



Hence, we find that 
(9.15) 

Let us now tackle 
It is clear that 



n-l 

$^$^(V2fc- V2fc)V* 
/=0 keGi 



0{n) a.s. 



n-l 



Pn = $^$^(V^2fc-V^2fc)V^2fe^fc. 



APn+l = Pn+1 -Pn=Y. (^^fc " V2k)V2k^Pk 



fcGGn 



a„ — a 
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Since, for al k E G„, E[V2fc|^n] = a.s. and E[V"2^^|J>j] = P{Xk) a.s., we have 



(an 


— a\ 


fan 


— a\ 


\Cn 




\Cn 


-c) 



<^ki^i a.s. 



which allows to say that (P„) is a square integrable martingale with increasing 
process given by 



n-l 



(P)„ = 5^E[AP,+iAP,Vi|J-„ 

1=0 
n-l 



1=0 



t I ai- a \ lai- a 
ci-c) \Ci-C 



a.s. 



Consequently, if a = max(cr^, cr^), we obtain that 



n-l 



\{P)n\\<C^J2i( 



'di - a)^ + (q - c"^ 



2)ll#'tin|4tf a,s. 



1=0 
n-l 



<aJ2{{ai-ar + {c,-cr)J2{l + X, 

1=0 keGi 



k) a.s. 



leading, as previously via Lemma 5.1 and (5.4), to 

\\{P)n\\ = 0{n) a.s. 

The strong law of large numbers for martingale given e.g. in Theorem 1.3.15 of [TU] 
implies that 



(9.16) 



Pn = oin) a.s. 



Then, we deduce from (9.14), (9.15) and (9.16) that 
(9.17) \\Qn-i{r]n- Tln)\\ = 0{n) a.s. 



Moreover, we obtain through Lemma 5.1 that 



(9.18) 



lim T=r-^Qr. 

n— >oo Mi „ 



S4 S2 
S2 1 



a.s. 



and we can prove, through tedious calculations, that this limiting matrix is positive 
definite. Therefore, (9.17) immediately implies (5.5). We shall now proceed to the 
proof of (5.7). Denote 



where 



Vlk+l 



and J 



1 

1 
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It follows from (3.8) that 



fceT„_i 

Furthermore, one can observe that (-Rn) is a square integrable martingale with in- 
creasing process 

n-l 

i=o fceG; 

n-l 

= 5^ - WuYm[WkWi\J'i]J{Wu - Wk)^Pk^i a.s. 

i=0 fceG; 



£ E ({^' - wy-^ - 



i=0 fcGG; 
n-l 



V^fc a.s. 



(=0 fceG; 



Then, as previously. Lemma 5.1 and (5.4) lead to = 0{n) a.s. which allows 



us to say that i?„ = o{n) a.s. Furthermore 



{V2k - V2k){V2k+l - V2k+l)i'k 

[{V2k-V2kf + {V2k+l-V2k+l) 

.. n— 1 



1=0 



which implies, thanks to Lemma 5.1 and (5.4), that 



^ iV2k - V2k)iV2k+l - V2k+l)^k 



0{n) a.s. 



Finally, we infer from (9.18) that 



|W„ - UnW = O 



n 



a.s. 



It remains to prove the a.s. convergence of rjn-, Cn and z/„ to 77, C, and z/, respectively 



which would immediately imply the a.s. convergence of our estimates through (5.5) 
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(5.6) and (5.7). Denote 



(9.19) Nn = Qn-liVn - ??) = 5Z ^2/=^^= 

where V2n = '^2n~1^'^n- One can observe that (A^„) is a square integrable martingale 
with increasing process {N)^ given by 

n-l 

1=0 fceG; 



Hence, if 7 = max(yU^ — a^, 2cr^(j^, /i^ — o"^), we obtain that 

/=o fceG; 



l(A^)n|| < 

<7 5^ + 



a.s. 



fceT„ 



which leads, via Lemma 5.1 



to 



||(iV)„|| = 0(|T„_i|) a.s. 



Consequently, 



a.s. 



Then, we deduce from (9.18) and (9.19) that rjn converges a.s. to rj with the a.s. rate 



of convergence given in Remark 5.7 The proof concerning the a.s. convergence 



of C,n to C and the second rate of convergence in Remark |5.7| is exactly the same. 
Hereafter, denote 

(9.20) Hn = Qn-l{Vn - = ^ U!2ki'k 

where W2n = V2„V2n+i — z^Vn- Once again, the sequence (Hn) is a square integrable 
martingale with increasing process 

n-l 

1=0 k£Gi 

Moreover, if a = max(z/^^, z/^^, (a^ + c'"^)(o"^ + cr^)), we find that 

n-l 

which allows us to say, as previously, that 

^ n 



a.s. 



a.s. 



\Hnr = 0{n\T^_,\) and 



O 



\Tn-l\ 



a.s. 
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It clearly proves the a.s. convergence of to v with the last a.s. rate of convergence 



given in Remark 5.7, which completes the proof of Theorem 5.6 



10. Proofs of the asymptotic normalities 

The key point of the proof of the asymptotic normality of our estimators is the 
central limit theorem for triangular array of vector martingale given e.g. in Theorem 
2.1.9 of |1U) . With this aim in mind, we will change the filtration considering, instead 
of the generation wise filtration (J-'n), the sister-pair wise filtration given by 

Qn = o {Xi, (X2fc, X2fc+i), \<k<n\ . 



defined as 



10.1. Proof of convergence ( 5.8[ ). We will consider the triangular array of vector 
martingale (M^ 

(10.1) 



(n) 



k 



where 



D, 



f X1V21 \ 

X1V21+1 
\ V21+1 J 

It is obvious that (M^")) is a square integrable vector valued martingale with respect 
to the filtration {Qk)- Moreover, we can observe that 



(10.2) 



(n) 



MJ- n 7 -I 



1 



n+1 



where tn = |T„| = 2"+^ — 1. In addition, the increasing process of this square 
integrable martingale is given by 



1 



1=1 

k 



IT 



1=1 



rA2^[Q{Xi) RiXi] 



xf X, 

X, 1 



a.s. 



Then, (5.2) leads to 



lim (M("))t„ = L a.s. 

n— >oo 

We will now establish Lindeberg's condition thanks to Lyapunov's condition. Let 



k=l 



/fc-1 
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It follows from (10.1) that 

[(1 + ximi + v,ur\ g,_,] , 



k=l 



k=l 



Since we already saw in Section [9] that 

E [V,\\Tn] < + Xlf and E[^l+il-^J < + X!)' a.s. 
where /i^^ = max(/i^, Sa^a^, /x^) and fi^^ = max(/i^, 3a^a^, /i^), we have that 

,4 J ,,4 \ *" 

ac 

Wr. 



2\4 

J a.s. 



k=l 



leading, via Lemma 5.1, to 



lim ( 

n— ^-oo 



= a.s. 

Consequently, Lyapunov's condition is satisfied and Theorem 2.1.9 of [10] together 

1 M„^Ar(0,L). 



with (10.2) imply that 



Moreover, we easily obtain from Lemma that 



(10.3) 



/2 (g) C = r a.s. 



where C is the positive definite matrix given by (5.3). Finally, we deduce from (4.1) 



together with (10.3) and Slutsky's lemma that 



10.2. Proof of convergence (5.9). We will now consider the triangular array of 
vector martingale {N^"*) defined as 

k 



N, 



in) 



I Jin I 



It is obvious from (|9.19|) that 
(10.4) 



(n) 



-rQniVn+l - V) 



-.K 



n+1- 



Moreover, we also have 

nvL\Gn-i] = U - ^1)X'^ + ^crlalXl + if^t - at). 
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Hence, the increasing process associated to the square integrable martingale (A^*^")) 
is given by 



k 



1=1 
k 



1^ E - ^')Xt + AalalXf + {^t - at)) i^i^^ 

I "I 



and Lemma SJ. allows us to say that 

hm (iV(")),„ = M„ 



a.s. 



As previously, we now need to check Lyapunov's condition. For a > 4 such that 
(H|5]) is satisfied, denote 



We clearly have 



fc=i 



Gk-i 



T^/2kUkr<T^/2kii+xir, 



leading to 



(10.5) iiivf-ivair/^< ^^1-2.1-/^(1+ x,^r/^ 

I " I 

Moreover, it exists some constant /3 > such that 

(10.6) <mv2kr + \Xkr + i). 

In addition, it exists some constant 7 > such that 



(10.7) 
Denote 



\V2kr<i\ak-a\\Xk\ + \e2k-c\r, 

<7(|a,-anXfcr + |£2fc-cr). 



Y = max ( sup sup E[|afc — a|"| J^i], sup sup ]E[|£:2fc — c|"| 

, n>0 feed n>0 feeGn 



It clearly follows from (10.7) that 



n\v2knSk-i]<iYi\x,r + i) a.s. 
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Consequently, we deduce from (10.5) and (10.6) that it exists some constants 6 > 
and C > such that 

^ E ^iTV/fV + \x.m + xir'^ a.s. 



k=l 
t 



^5{1 + Y) 



E 

k=l 



a.s. 



I ^ n I I ^ n 



k=l 



where ^ = q;/4— 1>0. Moreover, we can obviously suppose that a < 5 and we can 
prove via the same lines as in Section [t] that, as soon as IE[a;'j°] < 1, Ef&n"] < 1 ^^"^ 

supE[e2°] < oo and sup E[£:2°+;^] < oo 

n>l n>l 

it exists some positive constant ^ such that, for all n > 0, E[X^°] < /i. Therefore, 
the Borel-Cantelli lemma clearly ensures that 

1 1 *" 
lim ^(1 + ) = a.s. 



k=l 



which implies that 



lim 0„ = a.s. 

n— >oo 



Thus, Lyapunov's condition is satisfied and we infer from Theorem 2.1.9 of [TU] and 
( p^ that 



10. 



Finally, (9.18) together with (10.8) and Slutsky's lemma allow us to say that 



implying, through (5.5), that 



V\^n-l\{rin -V)^ A/'(0, Q-'MacQ-'). 



The proof of (5.10) follows exactly the same lines. 



10.3. Proof of convergence (5.11). The last step is to prove the asymptotic nor- 
mality given by (5.11). We will once again consider a triangular array of vector 
martingales {H^""^) defined as 
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We clearly have 



1 _ 1 



Consequently, (iJ'^"-') is a square integrable martingale with increasing process given 
by 

k 

Moreover, we can easily obtain that 

^[wln\Qn-l] = {vlb - plb)Xn + (f^a^d + Crl^l + 2pabpcd)Xl + {vl^ - pl^) a.S. 



Therefore, it follows from Lemma [5.1 [ that 

lim = H a.S. 

n— >oo 

Let us now verify that Lyapunov's condition is satisfied. For a > 4 such that (Hj5 
is verified, denote 



i=l 



a/2 



Qk- 



As previously, we obtain that 



and we can see that 

\w2k\ < \V2kV2k+l\ + \Pab\Xl + \pcd\, 

< \yik + \y2k+i + \pab\xi + \p,d\. 

We deduce from the previous calculations that it exists some constant ^ > and 
some a.S. finite random variable Y such that 

n\w2k\'''^\Qk-i] < e(l + Y){1 + \Xkn a.s. 
It leads, for some constant > 0, to 



a.S. 



Therefore, as before, we find that 

lim (h„ = a.S. 



n—^oo 



Finally, we obtain that 
alternatively 
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allows us to conclude that 
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